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ABSTBACT 

The findings of eight reviews of process-product 
studies are synthesized; Besults are organized under the main 
headings of time, instructional organization, monitoring* management, 
instruction, and environment. The paper begins with a brief history 

research cn teacher effectiveness, a description of the 
process-product paradigm, and a discussion of seme of the problems 
characterizing this type of research. The studies suggest that the 
effective teadhei (pr^.marily of low SES children in the primary 
grades) is one who (1) uses time efficiently, )ceeping students 
engaged with task-related acti^ties: (2) oroanizes students into 
tedium to large groups for instruction, (3) correctly monitors work 
while being available to provide answers to student-initiated 
ques.ticn8: («) assumes the role of .a strong leader; (5) asks 
low-order questions, ensures that students have the opportunity to 
"^^earn sufficient amounts of content, keeps interaction at a lew level 
of complexity, structures lessen^ so that students are aware of 
objectives: and (6) sustains a classroom environmen't that is wars, 
friendly, democratic, and relatively free.bf disruptive behavior. 
(Authcr/CTB) 
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> ABSTRACT 
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'The flndln'gs of. eight reviews of process-peoduct studies are\^_^"— 

synthesized: Berllnlr^and Rosenshlne, 1977; ^Centra and Potter, 1977; 

Gow;.1977; Medley, 1978; Rosenshlne, 1976, 1977; Soar, 1975; Soar and 

Soar 9 l977t Results are organized under the main variable headings of 

tline^ Instructional organization, monitoring, management, instruction, 
« 

and environment • The paper begins with s brief history of resear.ch on 
teacher effectiveness, a descrlptioTT of the process-product paradigm, 

r 

t 

and a discussion of some of the problems characterizing this tyj^e of 
I research, . ' 
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INTRODUCTION 

< Teacher effectiveness reseavch has long oct:upled a central position 
within the broader field of ^research on teaching. As Doyle (1977) points 
out, studies which have attempted to distinguish , superior from inferior 
teachers have been cohducted since "the 19200, increaslnil in number sinqe 
the 19508 with the formation of the AERA Committee on Criteria of Teacher 
Effectiveness (American Educational Research Association, 1953) • For a 
trief petiod, repdrts such as those of Coleman, Campbell, Hobson, 
MePartland, Mood, WeinfeJ.d, and York (1966), Jencks, Smith, Acland, Bane, 
CohenJ Gintis, Heyns, and ,Michel8on (1972), and Hosteller and Moynlhan 
i(1972) raised doubts about the influence of teachers on students' achieve^ 
ment In schools and led to controversy concerning the value of teacher 
effectiveness research* Thesp reports, however, were* ctUticlased on 
methodological grounds (e.gJ Centra & Potter, 1977; McPartland, Epstein, 
Karweit & Slavin,- 1976)^ At the time of their 1977 review, Berliner and 
Rosenshine summarised the general feelings of the research community 
toward the conclusions drawn in these reports in saying that "it is no 
longer acceptable to take seriously those who minimize the imtpact of the 
teacher, on the students* acquisition of knWledge'' (p. 381). tnvestlga-* 

s 

tions of teacher performance have thus continued to flourish; The recent 
emphasis given to the development of performance- and competency-based 
approaches tq teacher education, evaluation, and* accountability highlights 
the importance of the teache? effectiveness question In current research. 



Because of its long history, research on teacher- effectiveness has 
taken several for^ne. |arly research attempts f^used primarily, on 
discovering desirable teacher characteristics, which most *of ten were 

« 

Inferreil frotn ratings glVeji to teachers by students or principals. 
As Medley C1978) notes, Mthfit r.esultj^d from these eavly studies were 
prescriptions resembling boy scout laws for teachers, such as "a 
teacher Is warm, attractive, and kind." Research of this type continued 
unti^ the 1950s and, although interesting, produced relatively few out<^ 
comes that could systematically be applied in evaluating teiicher ef fee-' 
tiveness. Dunkin and Blddle (1974) quate the Committee on Cfi^erla of 
Teacher Effect^eness (AERA, 1953) in addressing the inadequacy of early 
research: 

The simple fact of the matter la that after 40 years of research 
on teacher effectiveness durini^ which ^ vast number of studies 
have been carried, out, one cati point to few outcomes that a 
superintendent of schools can safely employ In hiring a teacher 
or granting him tenure, ^:hat kn agency can employ in certifying . 
teachers, or that a teacher-education faculty can employ in 
planning or improving teacher reduce tion programs, (p. 657) 

Among the reasons for the failure of this research to produce useful 
information, Dunkin and Blddle (1974) note the following: (1) failure 
to observe teaching actfyities, (2) the^etical itrfpoverlshment, (3) 
use of inadequate criteria oi^^^fectiveness, and (4) lack of concern 
for conteiaual effects. 

During the late 19508, researchers initiated changes in an attempt . 
to address these problems* The most significant departure from earlier 



research ^as the relative abandonment of efforts to discover specific 
teacher characteristics. For the first time, researchers began to 
focus on t!te actual processes that characterize teaching in the class- 
room. .They began to rely heavily 'on observational techniques to delifte- 
ate teaching behaviors, and on objective measures of student outcomeiS 
to differentiate between desirable and undesirable teaching practices^ 
the goal of research on teacher effectiveness for about the past two 
decades h'^s thus been to establish relationships bet^reen. teaching be* 
ha*/iors (and noYe recently, 'stodent behaviors) and student achievement 
in cognitive and affective areas . The term "process-pjroduct" has been 
applied to this research because it attebpts to relate classr&om processes 
to student products (Itosenshine, 1971). 

A< great number of prcces8~product' studies have been condtkcted since 
the fifties, minicln and Blddlc (197A) noted at the time of their review 
that hundreds of studies of teacher effectiveness had been pid>li8hed 

« 

which used classraom observation techniques. They further commented 
that the need to evaluate the findings of these studies had made reviews 

of the literature In the field "almost yearly events" (e.g., Wlthall. 

V 

60; Medley & Mitzel,' 1963; Meux, 1967; Biddle, 1967; Nuthall, 1968, 




70; Flanders & Simon, 1970; Roscnshine, 1971; Rosenshine & Furst, 1973). 

Since Dunkin and Biddle' s (1974) review, several large-scale studies 

have been conducted (e.g^. McDonald & Ellas, 1975; Soar, 1973) which 

V 

have contributed substantially to the knowledge base in process-product 
"^research. Accordingly, reviews of the literature have continued to 



flourish in order to he].p assesa and integrates the result/) presented In 
these reports (e*g.» Hosenshine, 1976, 1977; Oow, 1977; Centra & Potter, 
1977; Berlitter A- Rosenshlne, 1977; Medley, 1978b). 

This paper takes the reviev process one step further. It attempts 
to 63r,ithesize the conclusio|ks drawn by recent (since 1975) reviewers 
of the literature in order to arrive at an ^en more integrated view 
of i:he. state of the art of process-product research. (Recent reviews 
are looked at exclusively, sin^ these most clearly reflect curreitt 
thinking.) More specifically, there were two pritnary reasons why tiiis 
review was initiated. First, the review was Initiated to facilitate 
the efforts of the Basic Skills Component by providing a concise iin'd 
well-integrated presentation of the results of teacher effecitiveiicjss 
research which could be used to assist practitioners in, developiug their 
capabilities to imprpve instruction in schools* Second i 4t was felt 
<^hat a revlevj of this type could assist meinbers of educational 
research community assess recent progress made on the teachers-effective- 
ness question and subsequently help guide future research* 

' The paper begins with a brief explanation of the process-product 
paradigm and a discussion of some problems currently affecting reseirch 
on teacher effectiveness. 

♦ 

«... ^ 
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THE PROCESS-PRODUCT PARADIGM 

DoyXe (1977) v/rltes cogently on the underlying assumptions, «ffec- . 
'tivenes8» and recent directions of the process-product paradigm. Most 
of the information U this section has been taken from his paper although 
chapter 3 from Dunkin and Biddle (1974) has contributed significantly. 

As stated in the introduction, the teacher effect Ive'ness question 
within the process-product paradigm is defined in terms of relationships 
between teacher classroom behaviors (processes) and measures of student 
learning outcomes (products) , Doyle cites Gage (1963) in saying that 
I this approach Is h&B^d . 
^^_»jftKMtf^^^ 't5)^^dlcators'^'g;r^ 
f ' effttctiveness/VBoyl* presents Rosenshine's (1971) description of the %^ 
bfislc stages or la procass-product study: 

(1) the development of an instrument which can be used 
systematically to record the frequency of certain specified 
teaching behaviors J (2) uses of the Instrument to record 
clasftoom behaviors of teachers and their pupils; (3) a 
ranking of the classr.<'omi3 according to a measure of pupil 
achievement adjusted for initial difference among the 
classes; and (4) a determination of the behaviors whose 
frequency of oc^currence is related to adjusted class 
achievement scores* (p. 18) 

Drawing from Gage's (1966) work,^Doylc notes that the results of 
process-product Inquiries are expected to have direct practical applica- 
tion for teacher education and school improvement efforts in addition 
to providing information in response to purely theoretical research 
questions. He comments that these practical considerations have 




Ivitluenc<j4 research In this fle.1.d by "directing choices about which 
ptQCQ&B diinensions to measure » which to manipulate, and how to Interpret 
the findings" (p. 6>. * 

"'Process variables" as defined by Dunkln and Biddle (1974) are based 
upon "all of the observable behi^^a of, teachers and pupils rather than 
upon only thdse that are productive of pupil growth or upon intangible 
or unobservabie relationships between teachers and pupils" (p. A4). 
This, however* should not be taken to mean that the effects of student 

♦ 

behavior or teacher behavior (or vice versa^) are discounted, but rather 
that in order for such effects to be considered true process variables, 
they must be able to be measured by overt behavioral signs*. This dis- 
tinctlon is an Important one. Since the onsef of process-product 
research, primarily because of the emphasis on teacher effectiveness 
research » clasdroom processed have been defined in terms of teacher 
clas£troom behavior. Although Dunkin and Biddle include pupil behavior 
in their definition, little attention has bean given to such processes, 
or to the causal "mediating" relationships between teadher behavior 
and pupil behavior, uptil recently (Anderson, 1977; Centra & Potter, 
1977; Doyle,* 1977). Evolving paradigms for "teacher effecti^ness" 
research are modifying the process-product mbdel to incorporate such 
roediating variables. 

"Product variables,** again as defined by Dunkin and Biddle (1974), 
refer to the outcomes of teaching, i.e., to "those changes that coni^ 
about in pupils as a result of their involvement in classroom activities 



with teachers and other pupils" (p, 46). The product variables most 
often Investigated are those that measure short-term learning In a sub- 
j^ct mattery usually reading or mathematics. Some researchers » however, 
(e»g» / Medlepr, 1978b) suggest that product 'variables should reflect 
long-»term gains Iti studies whose res^ults are to be used, for answering 

♦ r 

the teacher e^fec^tlven^ss question. , . 

Figure 1 presents "a model for 'the* study of classroom. teaching*' as 
presented iy Dunkln and Blddle (1974, p* 38).. Although, models are chang- 
ing (e.g., to Include ecological approarhes to research), the model 
offered by Dunkln and Blddle Is generally most representative of the main 
lines of ' thinking about teacher eff ectlvenesj^ research during the. past 
twenty years. 
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figure 1. A model for the study of classroom teaching. 



PROBLEMS AFFECTING PROCESS -PRODUCT RESEARCH 

/ 

Researchers of teacher effectiveness, especially for the past two 

* I 

decades »^ave been motivated by the desire to transform teaching Into 
an ettplrltally based science , and by the belief that the process of 
teaching is amenable to scientific Inquiry, namely that the activities 
of teaching are rational events which are observable and quantifiable 
atid which have discoverable causes and effects (Dunkln & Blddle, 1974). 
Given the problems which characterized earlier research on teacher 
effectiveness efforts, process-product research has contributed signifi- 
cantly to the start of an empirical knowledge base of effective teaching 
behaviors. However, as the researchers themselves ad^lt, problems -of 
productivity, methodology, and theory plague this type of research. 

V 

A brief discussion of these problems is Included here to alert the 
reader to their existence and to provide a more realistic basis by which 
to assess the conclusions presented in the paper. Many researchers have 
described the problems affecting process-product research (Centra & 
Potter, 1977; Berliner, 1976; Doyle, 1977; Dunkln & Blddle, 1974; 
McDonald & Ellas, 1975; Medley, 1978b). :>lnce Berliner's (1976) paper 
deals exclusively with the formulatiori of these probleiAs and incorporates 
most of the issues addressed by other researchers, the discussion which 
follows is based primarily Ln his writing. 

According to Berliner 76) , the problems which characterize process 
product research may be divided intor three categories: instrumentation, 
methodology and analysis. Problems with < instrumentation refer to 

,15 



difficulties encountered in clearly defining and operationallzing 

dependent and independent variables « In the case of dependent variables, 

* 

the question is one of finding appropriate Instruments to assess the 
effects of teaching. As Berliner points out, if off-the-shelf standard- 
Ized tests are used, one, runs the risk of not measuring the actual 
content that was taught In the classroom. Results may show weak corre^a*- 
tions between teaching processes and student achievement merely because 
the t^ts used to measure achievement are "more reactive to family back- 
ground and ethnicity than they (are) to instructional events" (p. 6). 
If tests for special teaching units are designed to h^lp ensure that 
the tests being used are content valid for a particular classroom, then 
the alternate problem which surfaces is one of . reliability. Ate measures 
of teacher effectiveness arrived at during a short period of time appro-^ 
priate for longer periods? Finally, dependent measures tarely address 

^ s 

simultaneously what students learn and what they feel about that learning 
a situation vhlch, Berliner feels, provides an unrealistic view of 
students' perception ^f learning in schools. 

Jhe first problem connected with Independent variables, used in 
teacher effectiveness studies is with the "appropriateness of teacher 
behavior" as defined by Berliner or, siraiarly, the "context of behavior" 
according to Medley (1978a)* The concern here is with the type of 

* Teaching units are specially designed mlni-coursf^s which can be used 
to try to control what teachers- teach and what students are exposed to« 



observation instruments used in process-^product research. These 
typically code only the frequency of teacher behaviors; they are not 
constructed to record the teacher's Intent or purpose for eliciting 
certain behaviors i or to take into account the context of behavior. 
As a result, the full implications of teacher behaviors are not 
studied andy in fact, results which are obtained are often inaccurate 
or misleading « The second problem is that of determining the appro- 
priate unit of analysis for the independent variable. As Berliner 
notes, researchers are very aware of the difficulties in deciding 
on the relative appropriateness of different* characteriasations of 
independent variables (for instance, should they consider the * 
single teacher question as the unit of analysis or the question 
along tdth the wait-time?). A third problen with defining ' independent 
variables concerns the stability of teacher v behavior. Berliner (1976) 
suggests that much more imst>e learned about ''which teacher behaviors 
fluctuatet and how and why they fluctuate over time, settings, cur- 
ricula, and populations" (p. 9) before valid claims can be mad6 

about the relationships between teacher behaviors and student outcomes. 

* 

A second set of loosely related problems and issues deals with 
methodology. The' most pervasive of the problems in this group is one 
wtiici has received much discussion and caused much controversy, namely, 
the problem of estimating how much one can legitimately expect 
teachers and schools to Influence student achievement. The reports 
of Coleman et al. (1966), Jencks et al. (1972), and Hosteller and 
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Mpyn^n (1972), although criticised on both nethodologlcal and sta- 

♦ 

tlstlcal grounds (e.g., Bejrllndr & Rosenshlne, 1977; McPartland et 
al., 1976$ Spady, 1976), Imply tha^ schools have minimal effect on 
studaiit achievement, and that factors such as Intelligence, ethnicity 

m 

and socioeconomic status are the major determinants of school outcomes* 

K second related methodological problem concerns the^subject 
matter (s) In which student achievement Is' expected, or at least tested 
for. In teacher effectiveness studies. Based on the findings of the 
International Education Association (lEA) cross-cultural study of 
student achievement (Postlethwalte, 1973), performance In subjects 
like reading and social studies Is Influenced to a large extent by 
home variables, more so than achievement In curriculum areas llk^ 
physics and French which are more likely to be Influenced by dlf fer-» 
entj^al classroom instruction. Betliner cautions that researchers 
should perhaps discontinue the use of achievement measures In areas 
such as .reading (one of the most common, areaa students are tested in) 
and conceptrate on areas wher6 the greatest teacher effects might 
be Bmen. . ' ^ * 

Another Issue which Berliner (1976) and Medley (;L978a) discuss 
arises from the fact that much of the research on teacher effejstiveness 
is norm-referenced. Because of the normative nature of these studies » 
some teachers will always appear to be better than others, but in 
fact the entire sample may be poor when ^judged against an absolute 
standard. MedJ^ highlight^ this problem by asking: (1) now good 
do we want effective 'teachers to be? and (2) Will resetirchers and all 
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others Interested in improving teaching accent levels of teaching 

eatabllshed through such studies as represet l-ng competent teaching? 

Berliner suggests that when speaking of teac er competence researchers 
' should ref er^ to ^^more' and less effective*^ teav Hers rather than using 

the temts effective and ineffective, which impl^ "that teachers are 
.being Judged against an abfiolute standard. 

Four final methodological Issues that need to be mentio^^^Tare: 

1* The very nature of teacher effectiveness research masks teaching 
behaviors that are differentially effective for pupils of 
differing aptitudes, styles, personalities, and traits; 

2. Typical reseai;ch-*of- teaching deslj^s do not take into account the 
fact that teacher behavior does not influence student achieve* . 
ment directly but ±z mediated by the student *s own behaviors 

.and perceptions; 

3. Befiiiltions of Independent variables often lack the preclsi^on 
needed to measure their occurrence adequately; 

4. The questiSk exists as to whether teachers laalntaln the same 
level of effectiveness over time and over subject matter areas. 

} 

In dlscusslnf; statistical problems related to research on teacher 
effectiveness, Berliner (1976) points out that the issue is one of 
how to measure change without a true experimental design. He coomients 
that|^ although a whole rifnge of statistical techniques has been , 
examined* these still fall short of providing very reliable results. 

Finally, a problem Which results from all the other issues des- 
^crlbed is low productivity. Although process-product studies are 
numerous, their results are often disparate, not comparable, or at 
worst invalid, making it difficult for conclusions to be drawn. 

13 • 
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Consequently, after many years of _j:e8^ rch, relatively few definitive 
Statements can be made about effective teaching. As Centra and Potter 
(1977) comment^ however^ 

although research has not provided a (sound) foundation for 
planning empirically based change, It has yielded • • • sign-- v 
posts on which ^slgnlf leant progress can be based. The admin- 
istrator planning for educational Improvement In schools 

would be well advised to begin planning from this base. (p. 32) 

♦ 

Centra and Potter's position reflects 'the one taken in this paper in 
^atjteaq>ting tc p:|^esent a synthesis of the findings of process-product 
research which may be used by pra£;titioaers for 'school improvement. 
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A SYNTHESIS OF PROCESS-PRODUCT RESULTS 

The findings of eight reviews of the litj^rature will be synthe- 
sized in this section. Where appropriate, the studies^ on which the 
reviewers have based their conclusions will be specified so as not 



to. create what Medley (1978b) refers to as "a spurious consistency v 
in appearance," i.e., a situatioa-ln which results gain in credibility 
because several reviewers havelmiewed and based their conclusions 
on the results of the same studies.. Conclusions about effective 
teaching* practices that relate to student outcomes in areas other 
than reading or mathematics will not , be presented, since the purpose 
of the paper is to synthesiase findings exclusively in these two 
areas. The findings of the synthesis are reported by variable. No 
particular variable classificatdon system found in the literature has 
been used, e.g., the Cooley-tohnes (1976) constructs and variables, 
McDonald *s (1975) variable clasBificdtion system, or Medley's (1978b) 

... * 

classifications. Rather, the results of the reviews were allowed to 
speak for themselves and suggest their own organl^slition. 

This 'section is headed by a brief description of the revieSl 
iacluded in the synthesis, in which the reviewers* purposes, approaches, 
and constraints are discussed. In addition, where it seems to be 
warrattted, criticisms or cautions riised against the reviews are 
noted. 
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The Reviews 

\ - 

s 

Anyone interested in process-product research through the years 
has cone to depend on the reviews of Barak Rosenshine. The findings 

s » * 

y. 

of tvo reviews that he has authored (Rosenshlne, 1976, 1977) and 
one that he has co*authored with David Berliner (Berliner & Rosen- 
shine, 1977) have been included in the synthesis. Although Rosen- 
shine has had other revi^s which are frequently quoted in the 
literature (Rosenshine, 1971; Rosenshlne & FUist, 1973), these have 
not been considered since they reflect less recent trains of thought 
and do not suaaarize results of several key studies conducted since 
the tiiiis of their publication. The three reviews which have been 

included ard related substantively to, one another » thlb two 1977 

%^ , 

tides expanding and clarifying the earlier one. 

the objective of the 1976 review, which appears in the MSSE 
yearbook of that year, is to describe the major riftceni studies in 
classroom instruction and their results. Reviews of results on six 
variables are o||^red: time epent, conte^r.4ove^ed, woi^k groupings, 
teacher question^, child responses, and adult feedback. The first 



three of these variables were selected sin^e, according to Rosenshine, 
they appear to be important and are frequently^ overlooked in classroom 
research. The last three variables were selected be^cause they have 
frequently been studied in classroom research. Most of the results 
Which Rosenshine summarizes in this review come from the Follow 
Through studies of Stallihgs and Kaskowitz (1974) and Soar (1973), 
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and from the Texas Teacher Effectiveness Study by Brophy and Evertsbn 
(1974) . An attempt Is made to Integrate the results for each variable 
Itito a ^'Direct Instructional Model«^^ ^ Rosenshlne explicitly states 
at the bftglnn^ of the review that Its scope Is deliberately limited 
to primary-grade Instruction in reading and mathematics for children . 
of -low socioeconomic status in order to achieve !'a sharper focus." 
This, however, is al^o,due to the charaeteristics of the samples In 
the studies on which Rosenshine focuses. 

The article by Berliner and Rosenshine (1977), which appears a.8 
a chapter in Schooling and the im'&tiiition '^M^mmX^^i , presents 
a description of how knowledge la acquired In the classroom. The 
authors begin the review by stating that attempts to study knowledge 
acquisition must, at a minimum, "focus on thts curriculum to hf taught, 
the method by which information is communicated, and the teachih:*s 
role in fostering the acquisition of knowledge and skills so that 
classroom instruction is Interesting', comprehensible, and pleasant" 

t ' ' ' . 

♦ 

(p* 375). The review discusses results for essentially the same 
types of variables found in the earlier review, although the authors 
also draw from the resuitaof two new studies: McDonald (1975)' and 
Tikmoff, Berliner, and Rlst (1975). Cosiaenting on the article, 
Phillip tr. Jackson (1977)' of the University of Chicago states that 
Berliner and Rosenshine have been too optimistic in their appraisal of 
the results of reseatch and suggests that researchers of teaching 
should reevaluate their techniques and perhaps also their goals. 
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The third review by Roaeashine, which was presented at the 1977 
annual aeeting of the American Educational Research Association, is 
essentially a suaotary of the previous two reviews. At the beginning 
of the article, Rosenshlne notes that three major changes in thinking 
have occurred since ^973 with respect to ^the types of inqOlties 
researchers believe will suggest the most productive instructional 
strategies: * < 

e 

1. An increased focus on student variables such as content 
'Covered <or opportunity to learn) and student attention to 

\ relevant acadeiolc activities, ^ . 

■ f X I . • • 

2. A gpnvergence of results supporting several components of 

moael of "direct instruction," and 

'3. H^v Information on the proportion of student time si)ent 
in seatwork and in discussion, with implications for the 
rdle of the teacher. (Rosenshlne, 1977, pp. 1-2) 

The review conducted by Doris 00^^1977) of the teaming Reseafch 
and Development Center (University of Pittsburgh) was connlssioned 
by the Pennsylvania School Improvement Program (PSIP), a consortium** 
of agencies that work closely with schools to help them use research 
and development information for self- Improvement. A synthesis of 
research was needed in 'order to more knowledgeably prescribe improvement 
strategies for target schools. The approach of the review is thus very 
practical. Research information Is limited to the basic skills areas and 
is presented according to the Cooley-Lohnea (1976) constructs: opportunity, 
motivators, structure, and instructional events. 

A paper prepared by John A. Centra and David A. Potter (1977) 
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for Research for Better Schools as part of their study of school va iables 



begins with a, justification of a wlthln-school (as 0t>pO8ed to a between'- 
school) approach to the study of Instructional variables. The discussion 
of wlthln-school factors Is further organized according to school varl*' 
ables and teacher variables. The review, ocncludes with. a lengthy dis- 
cussion of the Inpllcatlons of the results presented for practice , 
knd research. 

* 

A paper by Robert Soar (1975), and one by Rob^t Soar, and Ruth 
Soar (1977) suinftarlze findings for four o2 those' authbrs' previous 
studies of teacher effectiveness. The more recent paper reiterates 
the conclusions presented In the earlier paper by presenting a para-, 
dlga for thinking about classroom management and environment* The. 
four studies, whose results were Integrated, are as follows: 



Study SC'3-6 (Soar, 1966, 1968) Involved fifty-five urban 
classrooms In central South Carolina, grades throe through . 
slK, all white pupils f f panning all socioeconomic levels 
'but with the upper levels overrepresented. Study ft 1 
(Soar & Soar, 1972) Involved twenty first grade classrooms 
In Project Follow Tht^^^gh, with both black and white pupils, 
predominantly dlsadvant«.ged. Study Fla 5 (Soar 6 Soar, 
1973) Involved flfty-ulne fifth grade classrooms In n&tth 
Florida, Including all levels of socioeconomic status but 
with the lower level^more strongly represented, and was 
divided appro^lmaUfSty evenly between black and whlt^e, boys 
and girls, ruraj^^d urban. Study Fla 1 (Soar & Soar, 1973) 
also from noprti Florida, had twenty-two first grade urban 
classro'omsTwith black and white pupils, spanning the socio- 
economic status levels. (Soar & Soar, 1977, p. 1) 



The most recent review and the last of those included In the syn- 
thesis, is that of Donald Medley (1978b), which was cossmlssibned by the 
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CowftitCee on Perforotance-Based Teacher Education (PBTE) of the 

AMfetican 'Association of Colleges for Teacher Education (AACTE). 

In the .words of the author, the prlwary purpose of the report Is 

•'to provide the teacher feducator with access to the meaningful 

flndloss of research In teacher effectiveness" (ifedley/ 1978b, p. 1). 

It Is helpful to notf , however, that Medley acknowledges* the inter Itp 

nature of the findings and explicitly states that he h^ attempted 

to present, information which can be used to itsprove teacher education 

now while researchers strive for more definitive results. 

Medley's approach to the review is unique land demands some 

i 

explanation. Frooi an original list of 732 studies discussing effective 
t^chlng ,,ractlces, 289 remaingid after an initial weedlng-out pro- 
cess that rejected studies primarily if they reported.no original 

> 

research, i.e., if they were review^ of the literaturift or, discussed what 
good teachers should do without presenting data. The 289 items 
which remained were examined for the type of process-product relation- 
ships they reported. Four criteria were used in deciding whether a 
relationship should be included in the review: 



1. The study from which a relationship came -had to be • 
designed so that the relationship was generalizable 
to some population of teachers larger than the sample 
studied. 

2. The relationship had to be both reliable enough to be 
statistically significant and large enough to be practically 
significant. . ^ 

3. The measure of teacher effectiveness had to be based on 
long-term pupil gains in achievement areas recognized .as 
important goals of education. 
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4. The process measure had t<y specify the behaviors exhibited 
In such a |ray that they could Be reproduced as 
desired. (Medley, 1978b, p. 5)^ 

After these' criteria had been applied to all the relationships 
reported between teacher behaviors and pupil outcomes ^ 613 relationships 
remain^, . coming from Just 14 of the 289 studies. These 14 studies 
are: Brophy and Evertson . (1974) ; Bemls and" Luft (1970); McDonald 
•and Ella* (^976); flaHis [n^' Serwer (1966); Harris, Morrison, Serwer 
and Gold 0968); Good and Grouws (1975); Soar (l966, 1973); Soar 
and Soar (1972, 1973); Stalllngs and Kaskowltz (1974); Solomon and 
Kendall (1976); Spauldlng (1965); ^d Coker, Lorentz, and Coker (1976). 

In the review, relationships are presented in tables to enable 
readers to draw their own conclusions. Medley, \owever, also offers 
hiiS own intepretatlon of^ the findings , organizing behi^viors which 
differentiate between effective and Ineffective teachers into three 
constructs: (1) maintenance of learning environment, (2) use of pupil 
time, and (3) quality of instruction. 

Another unique feature of this publication is the Inclusion in 
an appendix of the comments addressed to the 'first draft of the 
paper by a reylew panel of experts set up by the PBTE Comnilttee to 
assist Medley in task. The comments, most of which are highly ^ 
cqttplimentaryi provide an immediate source to which the reader may 
turn for elucidation and appraisal. Although these^comments will not 
be summarized here, one raised by several reviewers is worth noting • 
In drawing his own conclusions. Medley suggests that different types of 
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Instruction appear to be differentially effeptive for students 
of low and high socioeconomic status. Several reviewerii note 
that, although this may be essentially true, several factors must 
be considered which may be operating Irf making them true (e.g., 
language, cultural differences,' nutrition). In addition, such findings 
seem potentially dangerous if they are misinterpreted and not pro- 
perly elaborated. 

• A Synthesis of Results 

• ■ r 

In trying to integrate the varied results of process-product 
research into larger and more meaningful patterns, individual reviewers, 
as would be expected, hav* developed different constructs or organl- 
zational schemes in which to fit the findings. Medley (1978b), 
for instance, fits results that relate to work groupings within the 
larger organizational variable "use of pupil time," whereas Rosenshlne 
(197,6, 1977) summarizes findings for work groupings along with several 
oth^r variables, under the variabXe "direct Instruction." 
The synthesis presented here has tried to ignore the various organi- 
zational variables employed by the different' reviewers and. Instead, 
has let the insults suggest their own schemes. When all J.8 said and 
done, the fact remains that research results could probably be organized 
in a different way by anyone undertaking such a task. This, however, 
l8 not as disheartening as it first sounds, since with each new attempt 
to make sense out of process-product data, new Insights may be found 
or neW|;tdea8 suggested which may extend current thinking. 
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Tine 

The concept of time In various forms energes as one of the 

most discussed ^and perhaps one of the most ci^ltlcal variables 

<« < -* 

relating to student achievement. 

The ii%rlahle. of absolute time spent In school » although tiot a 
process variable , Is briefly discussed here to lend perspective to 

the rest of the discussion of time. Rosenshlne (1976), who draws 

♦ 

on the work of Wiley an^ Hamlschfeger (1974) and Harris et al. 
(1968), and Gow (1977), who also looks at the study by Wiley and 
Hamlschfeger and to one by Bond and Dykstra (1967) , conclude that 
the total amount of time spent In school (calculated from such 
Indices as average dally attendance, length of school day, and .length 
of school year) Is positively related to achievement In reading and 
mathematics. The variable of absolute time spent In achool seems 
Important In helping to determine Instructional success. 

An even more striking determinant of success^ however, judging 
from the conclusions drawn by Berliner and Rosenshlne (1977), Gow 
(1977), Rosenshlne (1976, 1977), and Medley (1978b) Is the use of 
absolute time In the classroom. Drawing heavily from the results 
of the Follow Through Study of Stalllngs and. Kaskowltz (1974), but 
also on the works of Bloom (1976), Harris and Server (1966), McDonald 
and Ellas (1976), and Soar (.1973), the reviewers conclude that greater 
Student outcomes are achieved when time class is spent on task** 
related "academic" activities rather than on nonacademic activities. 
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Thus, greater amounts of time spent in the classroom on reading 
and arlthaetlc and lesser amounts of time spent on such activities 
as arts and crafts, music, and dancing were found to correlate 
with higher achievement scores In reading and arithmetic. As 
Rosenshlne (1976) states, the results suggest that "the stronger 
the academic emphasis, the stronger the academic results" (pc 345). 
In a later paper (Rosenshlne, 1977), he warns, however, that the 
critical variable in terms of time usage is not how much time is 
allotted for academic instruction, but ^rather the actual number of 
minutes students are acti ly engaged In the learning task at hand* 
Gow (1977) in her review notes some Interesting findings from 
a paper by Guthrie (in press) on the effects of instructional time 
on reading. She notes that in Guthrie's study of sixth graders more 
instructional time benefitted low^S children in word recognition 
and comprehension, but that lncrea,8lng amounts of time did- not benefit 
middle SES children and had inconsistent impact on high SES children. 
These findings are interesting when Soar's '^rork (See Soar, 1975 and 
Soar & Soar, 1976) is considered.. Soar suggests that Increasing 
the amount of time spent on academic activities may only produce marginal 
returns, i.e., that the function relating time-on-task to student 
achievement is curvilinear. Guthrie's finding that greater amounts 
of instructional -time were beneficial for low SES children seems con- 
sistent with the findings of the other studies noted, whose samples 
condisted mostly of low SES children. . 
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Inatructlonlil Organlgatlon 

Instructional organization refers here to the ways teachers 
.group students for Instruction. Berliner and Rosenshlne (19^77), 
Gow (1977), Medley (1978), and Rosenshlne (1976, 1977), looking 
primarily at the results of the Stalllngs and KaSkowltz (1974) study, 
conclude that the nost effective organisation has the teacher working 
with small groups of three to seven children or with large groups 
of elgjit or more children. The reviewers note that Ih this study. 
Instances of children working alone or of one or two children working 
with the teacher were consistently negatively correlated with 
achievement. * • 

ft 

Monitoring . 

Xategmlly related to the flndinge ccmcernlng work groupings 
are reaulte that suggest that higher achlevenent gi^iAs are ohtalnsd 
when students* work In groups is supervised by Che teacher # Medley 
(1978b), Rosenshlne (1976, 1977), and_Soar (1977), drawing primarily 
from the work of Soar (1973), note that when students work In groups 
under adult supervlsldn, correlations with achievement are positive 
and often significant. * 

<^ • • 

Results pertaining to the monitoring of seat work, which essen* 
tlally may be considered a type of grouping, are consistent with those 
reported for small groups. Berliner, and Rosenshlne (1977), Medley 

(1978b), and Rosenshlne (1977) address these findings. Basing their 

• * ' ' ' 

* ^ 
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eondualona on the works of Coker, Lorentz, and Coker (1976), 
HoDonald 4md Ellas (1976). Soar (1973), and Stalling^ and Kaskowitz 

(1974) , they note that achievement Is lower In clashes which 
display the largest awounts of .unsupervised seatwo)^k» As Rosen- 
shine (1977) points out, results from the studies of McDonald and 
*Ellas (1976) and Stalllngs and Kaskowltz (197A) imply that unsupervised 
students are less academicall'y engaged with their tasks than super- 
vised students, a fact that may partially account for the negative ^ 
correlations Vlth achievement, in the same paper, Eosenshine also 
cites the studies of Brophy and Ever tson (1974) and Good and- Grouws 

(1975) .which found that teacher initiated contacts during seatwork 

r 

were negatively related to achievement gain, whereas student initiated 
contacts were positively correlated with achievement. It wOuld seem, 
as Rosenshlne suggests, that the availability of the teacher' for 
answering qiutstions is very important to the success of seatwork 
activities .^he "covert" supervision provided in such settings may 
be the correct amount and type needed for effective instruct ion * 

Managettent ^ 

Whereas monitoring refers more to the supervising behaviors 
teacherfif perform, management refers collectively to all the behaviors 
teachers exhibit to form the ground rules by which instruction and 
interaction occur in the classroom. Rosenshlne (1977) Soir (1977) 
and Medley (1978b) discuss findings which relate to this variable. 




Rosenshlne (1977), It. addressing teacher roles, draws from 
the results ot studies by Stalllngs and Kaskowltz (1974), Soar 
(1973), and Solomon and Kendall (1976). He notes that teachers 
uho played the role of strong leaders in their classrooms, i.e«, , 
"directed activities without giving their students choices, approached 
the isubject. matter Un ii direct, business-IIlre way," organized learning 
around questions they posed, and occupied the center of attention^ 
(p* 11) t were the most successful in. achieving student gains. Tht 
data thus suggest that more effective teachers exert the role of a 
powerful leader in order to manage the tasks and interactions of thi 

* 

classroom. 

Rosenshine (1977) reinforces the notion of strong teacher . control 
by first cltihg results from the study by Soar (1973) in which 
student free choice, student limlj^ed choice, and free worH groups 
related to lower achievement, and secondly from the study by Stalllngs 
and Kaskowits (1974) , in Which student selection^ seating and work 
groups, atid among several concurrent activities produced negative 
correlations with achievement gain. ik>th the Soar (1973) and the 
Stalllngs an4 Kaskowit^e (1974) data were obtained for children of 
low SES. Another stud^ Which Rosenshine discusses (Solomon & Kendall, 
1976) yielded similar results with children of middle SES, The study 
showed that classrooms' in which students wer^i allowed to choose their 

♦ . ' - 

own activities, and were dei^endent on the class rather than on the 

tea her for planning, were disorderly and noisy, and were characterised 

by low achievement gains. 
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Soar (1977) > in xeviewing his own studies, came to essentially 
the same conclusions as Rosenshtne did, but elaborated those 
conclusiona by noting that dh Intermediate position with respect 
to teacher control is associated with. the greatest pupil gains. 
He suggests that neither extreiae'^ degrees of teacher control nor extrem^ 
lUKOunts of pupfi ^eedota and free choice are functional > again reln- 
for'cing his notljon bf the curvlllnearity of many functions relating 
classrooa processes to student achievefoent. 

Hedley's- (1978b) findings from three studies trophy & Bvertson» 
1974; Coker, Lorentz» & Coker, 1976; Hariris & Server » 1966) suggest 
that teachers of classrooaifl showing high achievement gains devote 
less t^ to management than teachers of low achieving ciassrooms* 
In addition > findings imply that more effective teachers use lesser 
amounts of criticism to cpntrol their classrooms and depend instead 
on a much more varied set of maitageriat techniques. 

Xnstryctioai< # 

Results synthesized in this section reflect any relationships 
found between the content of instruction and student gain« Content 
of instruction, as used here, refers to any materials, patterns of 
sequencing and organization, methods of questioning, and the like 
that characterize the transmission (and reception) of Information in 
the classroom* 

The first variable of Importance is what Rosenshine (1976, 1977) 
has termed ^'content covered** when referring to the opportunity students 




have to Aeam the content on which they will be tested. 
Roaehahine (1976) » citing data f ron Harris and Server (1966) and 
Pidgeon (1970)* and in^he 1977 paper* citing results from 
McDonald and Elias (1976) , concludes that the amount of a subject 
covered is critical in determining student performance. Reduced to 
simple terms » these findings suggest 6hat, if a studsnt has not 
been taught what he or she is being tested for, then achievement will 
be low« Cooley and teinhardt (1975) address this Issue, by creating 
a process variable category termed "criterion-relevant ihstiniction," 
i^ich refers to the degree to which a curriculum teaches what tests 
of achievement measure. 

Basing his conclusions on the studies of Soar (1972, 1973), 
Stallings and Kaskowitz (1974), and Coker, Lorentz, and Coker (1976), 
Hedlay states that effective teachers of low SES pupils ask more 
lower order questions than ineffective teachera do, whether outcomes 
are computed for reading or arithmetic. From the Brophy and Evertaon 
(1974) study, he concludes effective teachers also ask fewer questions 
that offer a limited choice of answers. 

Medley also presents interesting results concerning the effective- 
ness of differeint teacher reaction patterns to pupil responses. He 

♦ 

notes that in three studies-^one a doctoral dissertation (Perham, 1973) • 
and two from the fourteen he included in his analysis (Soar, 1973; 
Bfophy & Evertson, 1974)— results indicate that effective teachers 
(of low SES> pupils) are less likely to elaborate or discuss pupil 
anstera than<are ineffective teachers. Medley states that there is some 



evidence (Stalllngs & Kaakowit^, 197^; Brophy ^Isvertson, X974) that 



effective teachers ackncwledge the pupil redtfonse or quickly pro- • 



vide leedbacic and then continue with the main task. In addition, 
Medley cites Coker, Lorentz, and Coker (1976), and Brophy and ^ 



It seems clear that In low SES classes at this (primary) 
leveli the competent teacher keeps litteractlon at a Imr 
level of complexlty-and- pupil Initiative. , tie or she. does 
not ^encourage puplll^^ analysee, syntheslse, evaluate, 
or indeed to do anydhing but answer rather narrow questions 
asked by the teacher* The teacher who encourages such 
pupils to express themselves freely, to. think, to question, 
to discuss, is not effective in teaching them to read or 
do arithmetic, (Medley, 1978b, p. 17). 



Results which are related to those found for teacher questioning 

* 

and response patterns are those concerning child response patterns. 
Drawing primarily from the s'tudy of Stalllngs and Kaskowltz (1974), 
Rosenshlne (1976) concludes that pupil responses to direct academic 
questions provude significant and positive correlations with achieve- 
ments, whereas pupil responses to nonacademic questions and to open- 
ended questions correlate negatively wl.th achievement. In addition, 
he cites the study by Brophy and Evertson (1974) when he says that 
the correctness of student answers was found to correlate differentially 
with achievement for low and high sts children. For low SES children. 




Evertson (1974) in saying that eff€^ctive teachers are less likely 
to listen or provide* Redback to pupil-Initiated questions and 
comments. A quotation from Medley aummarlzes the questioning and 



response behaviors 




effective teachers of low SES children. 
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the p6¥eent of correct answers significantly and positively correlated 
tfdth achieveinent , whereas ior high SBS ctftdren, the percent of wrong 
Answers showed a significant and positive correlation. Rosenshine 
interprets these results as suggesting that children of low SES 
should be asked questions near their level of ability in order to 
increase the probability of correct responses. In contrast, children 
of higK SBS should be asked questions slightly above their ability 
level, in. qr^der to challenge their thinking, 

A fourth variable, which is also, related to the two that have 
just been discussed, concerns the types pf teaching activities that 
occur in the classroom, or what Kosenshine (1976, .1977) and Berliner 
and Rosehshlne (1977) discuss under the heading *'ways of spending 
direct instructional time." Looking at >^he data from the Brophy 
atid Evertson (1974) study, Rosenshine, Rosenshine atid Berlinsf , end 
Hsdley .(1978b) no'te that low SES children profit more ivom seatwork 
or individually prescribed learning activities, and do not benefit 
from activities which require oral responses. For children of high 
SES the opposite of these results was found to be trul* 

A final issue that relates to the form instruction takes in 'the « 

to 

classroom is structure. Berliner and Rosenshine (1977) present the 
results of an ethnographic study conducted by Tikunoff , Berliner, 
and Rist (1975) to suggest that lesson structure, "defined primarily 
as the teachers' preparation of students for a particular lesson" 
(p. 3&2) is an importimt determinant of achievement. Teachers who 

3^7 



were Identified as effective- i|i producing high student achievement in 
the study Inloraied students of the objectives of lessons, end of their 
own expectations for aehievenent) and linked current lessons with 
material pre'viottsly studied. Thus it seems, 'as Berliner and Rosenshine 
conclude^ that structuring, or "goal setting," relates significantly 

to students* aei^ul^ition of knowledge. 

, ■ ... > 

iM^fOttaient 

Classroom environment, perhaps one of the most frequently dis- 
cussed issues in educational research, is the final variable for 
which results will be presented. Environment, in this section, refers 
to all the behaviors which contribute to the support and enhancement 
of the true tional tasks in the classroom. Several reviewers ' 
address this issue. 

Medley (1978b), looking at the studies of S tailings and Kaskowits 
(WA)., Harris and Server (1966) , .and Brophy and Evertson (1974) , 
concludes that efS€htive teachers use more praise and positive moti* 
vat ion in their interactions with students. In addition, he notes 
that the results of one study (Stalllngs & Kaskowitz, 1974) suggest 
that effective teachers use more tokefi reinforcements in their class- 
rooms. The results of another study (Brophy & Evertson, 1974) imply 
that ineffective t<^chers make more frequent use of duch things as 
gold stars and special privileges. 

Eos-enshine (1976, 1977) and Berliner and Rosenshine (1977) discuss 

> 

32 

.38 



aome other interesting findings of the St&lllngs and Kaskowicz study 
with respect to the provision of feedback by the tescher. In the 
Stalllngs and Kaskoiilts study, data pertaining to student praise and 
criticism ware categorised according to focus » either academic or 
nonacadeid.c. As the reviewers note, the results of ^thls study show 
that both teacher i^raise and criticism directed toward atudents ^re 
effective when focused on academic activities. In contrast, teacher 
feedback negatively related to student achievement when given for 
nonacademic behaviors* The reader Is reminded, however, that the 
sample for this study was composed of low SES studeikts* Consequently, 



results may only apply to this socioeconomic group. 



Some related 



fln4ings of Brophy and Evertson (1974), which Rosenfihlne (X976) notes, 

...J 

do seem to add to the credibility of these results* Rosenshlne 
tMorites that in the Brophy and Evert sen study,/Wthin the high socio* 
econoltlc status of classrooms, significaiit and negative correlations 
with achievement were obtained for (a) frequency of teacher questions 
about self, (b) procedural contacts, as compared to substantive 
contacts, and (c) student -Initiated contacts Involving personal concerns 
(p. 347). Kegatlve but non-significant correlations were four d for 
low SES\ students. ^ 

Soar*s (1977) paper sh^s some light on the differential utility 
of positive affect on low and high SES childrim. Basing his conclusions 
primarily oii the results of one of his studies (Soar & Soar, 1973)^ 
he suggests that high SES students learn better in classes in which 



\ 
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teachers exhibit slight negative affect, whereas low SBS students learn 
less In this type of i&nvlroiuaent . He notes that Brophy and Evertson s 
(1974) study revealed similar trends. , 

Roaenshlne (1977) cites results of two studies 'which add to our 
under stajadlng of feedback, and more clearly specify the qualltle^ of 
an effective claii^^om environment. First, he notes the ethnojgrdphlo 
Study conducted by Tlkunoff, Be*l|.ner, and Rlst (1975), In ^Ich 
higher achieving classrooms were characterized as being "convivial, ' 
cooperative, democratic, and warm," whereas In the lower achieving • 
classrooms there was more "belittling, shaming of students, and the 
use of sarcasm" (p. 20). In addition, Eosenshine writes that 

, Solomon and Kendall (1976) also found that teacher criticism of student 
behavior, shouting,* scolding, ridicule, and sarcasm were conslstent3.y 
negatively related to achieveteent gain" (p. 20). 

On* last finding is of interest. Medley (1978b) notes that 
results of five studies (Soar, 1973; McDonald & Kllas, 1976; Brophy 
& Evertson, 1974; Bemls & Luft, 1970; Coker, Lorentz, & Coker, 1976) 
indicate that there Is less deviant or disruptive beshavior in the 
classes of effective teachers. 
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SUMMARY REMARKS 

* 

Despite Its many flaws, process-product research (especially 
recent research) has produced a set of interim findings that educators 
and administrators may find useful in improving instructional 
practices in schools while awaiting more definitive results* In this 
report, these findings have been organized under the headings of 
.tine, instructional organization, monitoring, management, instruction, 
and envlronmeijit. In sum, they suggest tlikt the effective teacher 
(primarily of low SES children in the prlmA^y grades) is one who (1) 
uses time effi,ciently, keeping students engaged with task-related 
activities; (2) or'ganizes student-s into medium to large groups for 
Instruction; (3) correctly monitors work while beitig available to 
provide answers to student- initiated questions; (4) assumes the role 
of a strong leader; (5) asks low-order questions, ensures tht^t 
students have the opportunity to learn sufficient amounts of content, 
keeps interaction at a Iqw level of complexity structures lessons 
so that students are aware of objectives; anu (6) Sustains a classroom 
environment that Is warm, friendly, democratic, and relatively free 
of disruptive behavior « , 
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